Skip to content

Conversation

@Guikingone
Copy link
Contributor

@Guikingone Guikingone commented Nov 22, 2025

Q A
Bug fix? no
New feature? yes
Docs? yes
Issues --
License MIT

Summary:

  • Support for stt / tts and sts
  • Interfaces for SpeechProviders and SpeechListeners
  • Introduction of a SpeechConfiguration
  • New configuration block for configuring providers (requires a platform each time)
  • Introduce SpeechBag and SpeechAwareTrait

@OskarStark
Copy link
Contributor

To me we maybe should introduce capabilities also to platforms rather than having a voice component. As far as I understand I cannot use the Voice component standalone, right?

I don't think a dedicated component is the way to go here

@Guikingone
Copy link
Contributor Author

We can introduce it via the Platform, could be easier, the voice can be used without agents but it will requires the Platform at least.

Will update the PR to match this approach 👍🏻

@OskarStark
Copy link
Contributor

I agree, Agent scope is not needed 👍🏻

@Guikingone Guikingone changed the title [Voice] Introduce the component [Platform] Introduce VoiceProviders and VoiceListeners Nov 23, 2025
@chr-hertel
Copy link
Member

Hi @Guikingone, i agree that week lack some kind of guidance on how voices work - but same goes for other binary stuff like creating images or videos.

so two things i would like to understand

  • what's the high-level goal here - like what do you want to build?
  • why is it an extra component and not part of Platform?

btw, "speech" is more common than "vioce" isn't it?
btw2, have you seen the demo around audio and video?

@Guikingone
Copy link
Contributor Author

Guikingone commented Nov 23, 2025

what's the high-level goal here - like what do you want to build?

The main goal is to add the capacity to have an agent/platform that can "listen" and answer to inputs thanks to voice / speech (voice is used as a sugar here, could be renamed to speech), creating a workflow where you can submit voice, call the platform that transforms it to speech / text (depending on the situation you're in) and returning it to the user without frictions.

why is it an extra component and not part of Platform?

It is now part of Platform, I just pushed an update on it following the comment from @OskarStark.

btw, "speech" is more common than "voice" isn't it?

Agreed, could be renamed to Speech.

btw2, have you seen the demo around audio and video?

Yes, the goal is to ease it with a "built-in" approach / API that stays transparent for the user.

@Guikingone Guikingone changed the title [Platform] Introduce VoiceProviders and VoiceListeners [Platform] Introduce Speech support via Platform Nov 23, 2025
@chr-hertel
Copy link
Member

just realized we should the "audio" demo to "speech" as well - and i'm def not really happy with that solution there.

can we make it as easy as the structured output - like with an listener?

i like that starting point:

$result = $platform->invoke('eleven_multilingual_v2', new Text('Hello world'), [
    'voice' => 'Dslrhjl3ZpzrctukrQSN', // Brad (https://elevenlabs.io/app/voice-library?voiceId=Dslrhjl3ZpzrctukrQSN)
]);

echo $result->asVoice();

what would be the return type here? would it be same as asBinary() or asDataUri()

@Guikingone
Copy link
Contributor Author

can we make it as easy as the structured output - like with an listener?

Could be something to explore, the API is not locked for now.

what would be the return type here? would it be same as asBinary() or asDataUri()

My first approach was to do the same thing as asBinary to ease the usage.

OskarStark added a commit that referenced this pull request Nov 24, 2025
This PR was merged into the main branch.

Discussion
----------

[Demo][Website] Rename audio demo to speech

| Q             | A
| ------------- | ---
| Bug fix?      | no
| New feature?  | no
| Docs?         |
| Issues        |
| License       | MIT

Following a discussion of #943

Commits
-------

ffc2b64 Rename audio demo to speech
@OskarStark OskarStark changed the title [Platform] Introduce Speech support via Platform [Platform] Introduce Speech support Nov 24, 2025
@Guikingone
Copy link
Contributor Author

Well, might seems weird but here we go, stt, tts and sts are working like a charm ... 👀

@Guikingone Guikingone force-pushed the agent/voice_provider branch 3 times, most recently from 120f391 to 1963409 Compare November 26, 2025 12:42
@Guikingone Guikingone marked this pull request as ready for review November 26, 2025 12:44
@carsonbot carsonbot added Feature New feature Platform Issues & PRs about the AI Platform component Status: Needs Review labels Nov 26, 2025
@Guikingone Guikingone marked this pull request as draft November 26, 2025 12:46
@Guikingone Guikingone marked this pull request as ready for review November 26, 2025 13:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Feature New feature Platform Issues & PRs about the AI Platform component Status: Needs Review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants